Papers by Sreyasi Nag Chowdhury
CITE: A Corpus of Image-Text Discourse Relations (N19-1)
Copied to clipboard
| Challenge: | a crowd-sourced resource characterizes inferences in image-text contexts in the domain of cooking recipes . a recent study has found that image-image presentations are more effective at integrating text and image . |
| Approach: | They propose a crowd-sourced resource for multimodal discourse characterizing inferences in image-text contexts in the domain of cooking recipes in the form of coherence relations. |
| Outcome: | The proposed corpus enables a better understanding of communication and common-sense reasoning . it is particularly important for automating the understanding and generation of text-image presentations . |
SANDI: Story-and-Images Alignment (2021.eacl-main)
Copied to clipboard
| Challenge: | a method for selecting images from an image collection and aligning them with text paragraphs of a story is presented . judiciously placed images are used for multimodal descriptions and narration in stories . |
| Approach: | They propose a method for automatically selecting images from an image collection and aligning them with text paragraphs of a story. |
| Outcome: | The proposed method can select and align images with texts with high quality of semantic fit. |